Brain-computer interface for robot control with eye artifacts for assistive applications

Human-robot interaction is a rapidly developing field and robots have been taking more active roles in our daily lives. Patient care is one of the fields in which robots are becoming more present, especially for people with disabilities. People with neurodegenerative disorders might not consciously or voluntarily produce movements other than those involving the eyes or eyelids. In this context, Brain-Computer Interface (BCI) systems present an alternative way to communicate or interact with the external world. In order to improve the lives of people with disabilities, this paper presents a novel BCI to control an assistive robot with user's eye artifacts. In this study, eye artifacts that contaminate the electroencephalogram (EEG) signals are considered a valuable source of information thanks to their high signal-to-noise ratio and intentional generation. The proposed methodology detects eye artifacts from EEG signals through characteristic shapes that occur during the events. The lateral movements are distinguished by their ordered peak and valley formation and the opposite phase of the signals measured at F7 and F8 channels. This work, as far as the authors' knowledge, is the first method that used this behavior to detect lateral eye movements. For the blinks detection, a double-thresholding method is proposed by the authors to catch both weak blinks as well as regular ones, differentiating itself from the other algorithms in the literature that normally use only one threshold. Real-time detected events with their virtual time stamps are fed into a second algorithm, to further distinguish between double and quadruple blinks from single blinks occurrence frequency. After testing the algorithm offline and in realtime, the algorithm is implemented on the device. The created BCI was used to control an assistive robot through a graphical user interface. The validation experiments including 5 participants prove that the developed BCI is able to control the robot

Improvement of speed-accuracy tradeoff during practice of a point-to-point task in children with acquired dystonia

: The tradeoff between speed and accuracy is a well-known constraint for human movement, but previous work has shown that this tradeoff can be modified by practice, and the quantitative relationship between speed and accuracy may be an indicator of skill in some tasks. We have previously shown that children with dystonia are able to adapt their movement strategy in a ballistic throwing game to compensate for increased variability of movement. Here, we test whether children with dystonia can adapt and improve skills learned on a trajectory task. We use a novel task in which children move a spoon with a marble between two targets. Difficulty is modified by changing the depth of the spoon. Our results show that both healthy children and children with acquired dystonia move more slowly with the more difficult spoons, and both groups improve the relationship between speed and spoon difficulty following 1 wk of practice. By tracking the marble position in the spoon, we show that children with dystonia use a larger fraction of the available variability, whereas healthy children adopt a much safer strategy and remain farther from the margins, as well as learning to adapt and have more control over the marble's utilized area by practice. Together, our results show that both healthy children and children with dystonia choose trajectories that compensate for risk and inherent variability, and that the increased variability in dystonia can be modified with continued practice.NEW & NOTEWORTHY This study provides insights into the adaptability of children with dystonia in learning a point-to-point task. We show that these children adjust their strategies to account for increased difficulty in the task. Our findings underscore the potential of task-specific practice in improving motor skills and show higher level of signal-dependent noise can be controlled through repetition and learned strategies, which provides an avenue for the quantitative evaluation of rehabilitation strategies in this challenging group

A Multiple-Plasticity Spiking Neural Network Embedded in a Closed-Loop Control System to Model Cerebellar Pathologies

The cerebellum plays a crucial role in sensorimotor control and cerebellar disorders compromise adaptation and learning of motor responses. However, the link between alterations at network level and cerebellar dysfunction is still unclear. In principle, this understanding would benefit of the development of an artificial system embedding the salient neuronal and plastic properties of the cerebellum and operating in closed-loop. To this aim, we have exploited a realistic spiking computational model of the cerebellum to analyze the network correlates of cerebellar impairment. The model was modified to reproduce three different damages of the cerebellar cortex: (i) a loss of the main output neurons (Purkinje Cells), (ii) a lesion to the main cerebellar afferents (Mossy Fibers), and (iii) a damage to a major mechanism of synaptic plasticity (Long Term Depression). The modified network models were challenged with an Eye-Blink Classical Conditioning test, a standard learning paradigm used to evaluate cerebellar impairment, in which the outcome was compared to reference results obtained in human or animal experiments. In all cases, the model reproduced the partial and delayed conditioning typical of the pathologies, indicating that an intact cerebellar cortex functionality is required to accelerate learning by transferring acquired information to the cerebellar nuclei. Interestingly, depending on the type of lesion, the redistribution of synaptic plasticity and response timing varied greatly generating specific adaptation patterns. Thus, not only the present work extends the generalization capabilities of the cerebellar spiking model to pathological cases, but also predicts how changes at the neuronal level are distributed across the network, making it usable to infer cerebellar circuit alterations occurring in cerebellar pathologies

Automatic Setting Procedure for Exoskeleton-Assisted Overground Gait: Proof of Concept on Stroke Population

Stroke-related locomotor impairments are often associated with abnormal timing and intensity of recruitment of the affected and non-affected lower limb muscles. Restoring the proper lower limbs muscles activation is a key factor to facilitate recovery of gait capacity and performance, and to reduce maladaptive plasticity. Ekso is a wearable powered exoskeleton robot able to support over-ground gait training. The user controls the exoskeleton by triggering each single step during the gait cycle. The fine-tuning of the exoskeleton control system is crucial-it is set according to the residual functional abilities of the patient, and it needs to ensure lower limbs powered gait to be the most physiological as possible. This work focuses on the definition of an automatic calibration procedure able to detect the best Ekso setting for each patient. EMG activity has been recorded from Tibialis Anterior, Soleus, Rectus Femoris, and Semitendinosus muscles in a group of 7 healthy controls and 13 neurological patients. EMG signals have been processed so to obtain muscles activation patterns. The mean muscular activation pattern derived from the controls cohort has been set as reference. The developed automatic calibration procedure requires the patient to perform overground walking trials supported by the exoskeleton while changing parameters setting. The Gait Metric index is calculated for each trial, where the closer the performance is to the normative muscular activation pattern, in terms of both relative amplitude and timing, the higher the Gait Metric index is. The trial with the best Gait Metric index corresponds to the best parameters set. It has to be noted that the automatic computational calibration procedure is based on the same number of overground walking trials, and the same experimental set-up as in the current manual calibration procedure. The proposed approach allows supporting the rehabilitation team in the setting procedure. It has been demonstrated to be robust, and to be in agreement with the current gold standard (i.e., manual calibration performed by an expert engineer). The use of a graphical user interface is a promising tool for the effective use of an automatic procedure in a clinical context

The effects of robotic assistance on upper limb spatial muscle synergies in healthy people during planar upper-limb training

BackgroundRobotic rehabilitation is a commonly adopted technique used to restore motor functionality of neurological patients. However, despite promising results were achieved, the effects of human-robot interaction on human motor control and the recovery mechanisms induced with robot assistance can be further investigated even on healthy subjects before translating to clinical practice. In this study, we adopt a standard paradigm for upper-limb rehabilitation (a planar device with assistive control) with linear and challenging curvilinear trajectories to investigate the effect of the assistance in human-robot interaction in healthy people.MethodsTen healthy subjects were instructed to perform a large set of radial and curvilinear movements in two interaction modes: 1) free movement (subjects hold the robot handle with no assistance) and 2) assisted movement (with a force tunnel assistance paradigm). Kinematics and EMGs from representative upper-limb muscles were recorded to extract phasic muscle synergies. The free and assisted interaction modes were compared assessing the level of assistance, error, and muscle synergy comparison between the two interaction modes.ResultsIt was found that in free movement error magnitude is higher than with assistance, proving that task complexity required assistance also on healthy controls. Moreover, curvilinear tasks require more assistance than standard radial paths and error is higher. Interestingly, while assistance improved task performance, we found only a slight modification of phasic synergies when comparing assisted and free movement.ConclusionsWe found that on healthy people, the effect of assistance was significant on task performance, but limited on muscle synergies. The findings of this study can find applications for assessing human-robot interaction and to design training to maximize motor recovery

EMG-based visual-haptic biofeedback: a tool to improve motor control in children with primary dystonia.

New insights suggest that dystonic motor impairments could also involve a deficit of sensory processing. In this framework, biofeedback, making covert physiological processes more overt, could be useful. The present work proposes an innovative integrated setup which provides the user with an electromyogram (EMG)-based visual-haptic biofeedback during upper limb movements (spiral tracking tasks), to test if augmented sensory feedbacks can induce motor control improvement in patients with primary dystonia. The ad hoc developed real-time control algorithm synchronizes the haptic loop with the EMG reading; the brachioradialis EMG values were used to modify visual and haptic features of the interface: the higher was the EMG level, the higher was the virtual table friction and the background color proportionally moved from green to red. From recordings on dystonic and healthy subjects, statistical results showed that biofeedback has a significant impact, correlated with the local impairment, on the dystonic muscular control. These tests pointed out the effectiveness of biofeedback paradigms in gaining a better specific-muscle voluntary motor control. The flexible tool developed here shows promising prospects of clinical applications and sensorimotor rehabilitation

Spike detection algorithm improvement, spike waveforms projections with PCA and hierarchical classification

Definition of single spikes from multiunit spike trains plays a critical role in neurophysiology and in neuroengineering. Moreover, long period analysis are needed to study synaptic plasticity effects and observe the long and medium term development on which all central nervous system (CNS) learning functions are based. Therefore, the increasing importance of long period recordings makes necessary on-line and real time analysis, memory use optimization and data transmission rate improvement. A threshold-amplitude spikes detection method is chosen and 5 noise level estimate methods were developed. Than APs are bundled to group using principal component analysis and classified (hierarchical classifier). The system has lot of applications like high-throughput pharmacological screening and monitoring effects

A biofeedback cycling training to improve locomotion: a case series study based on gait pattern classification of 153 chronic stroke patients

<p>Abstract</p> <p>Background</p> <p>The restoration of walking ability is the main goal of post-stroke lower limb rehabilitation and different studies suggest that pedaling may have a positive effect on locomotion. The aim of this study was to explore the feasibility of a biofeedback pedaling treatment and its effects on cycling and walking ability in chronic stroke patients. A case series study was designed and participants were recruited based on a gait pattern classification of a population of 153 chronic stroke patients.</p> <p>Methods</p> <p>In order to optimize participants selection, a k-means cluster analysis was performed to subgroup homogenous gait patterns in terms of gait speed and symmetry.</p> <p>The training consisted of a 2-week treatment of 6 sessions. A visual biofeedback helped the subjects in maintaining a symmetrical contribution of the two legs during pedaling. Participants were assessed before, after training and at follow-up visits (one week after treatment). Outcome measures were the unbalance during a pedaling test, and the temporal, spatial, and symmetry parameters during gait analysis.</p> <p>Results and discussion</p> <p>Three clusters, mainly differing in terms of gait speed, were identified and participants, representative of each cluster, were selected.</p> <p>An intra-subject statistical analysis (ANOVA) showed that all patients significantly decreased the pedaling unbalance after treatment and maintained significant improvements with respect to baseline at follow-up. The 2-week treatment induced some modifications in the gait pattern of two patients: one, the most impaired, significantly improved mean velocity and increased gait symmetry; the other one reduced significantly the over-compensation of the healthy limb. No benefits were produced in the gait of the last subject who maintained her slow but almost symmetrical pattern. Thus, this study might suggest that the treatment can be beneficial for patients having a very asymmetrical and inefficient gait and for those that overuse the healthy leg.</p> <p>Conclusion</p> <p>The results demonstrated that the treatment is feasible and it might be effective in translating progresses from pedaling to locomotion. If these results are confirmed on a larger and controlled scale, the intervention, thanks to its safety and low price, could have a significant impact as a home- rehabilitation treatment for chronic stroke patients.</p